18.05 Lecture 2 
February 4, 2005 



§1.5 Properties of Probability. 

1. ¥(A) e [0, 1] 

2. ¥(S) = 1 

3. ¥(UA 1 ) = £ P(A,) if disjoint Ai n Aj = <fr,i J= j 

The probability of a union of disjoint events is the sum of their probabilities. 

4. P(0), P(5) = P(5 U 0) = P(5) + P(0) = 1 

where S and are disjoint by definition, P(S) = 1 by #2., therefore, P(0) = 0. 

5. ¥(A C ) = 1 - F(A) 

because A, A c are disjoint, ¥(A U A c ) = ¥(S) = 1 = ¥(A) + ¥(A C ) 
the sum of the probabilities of an event and its complement is 1. 

6. If AC B,¥(A) < ¥(B) 

by definition, B = A U (B \ A), two disjoint sets. 
¥{B) = ¥{A) + ¥(B \A)> ¥(A) 

7. ¥(A UB)= ¥(A) + ¥{B) - ¥{AB) 

must subtract out intersection because it would be counted twice, as shown: 




A B 



write in terms of disjoint pieces to prove it: 

¥{A) = ¥(A \B)+ ¥(AB) 

¥(B) =¥(B\A) + ¥(AB) 

¥(A UB)= ¥(A \B)+ ¥(B \ A) + ¥{AB) 



Example: A doctor knows that P(bacterial infection) = 0.7 and P(viral infection) = 0.4 
What is P(both) if P(bactcrial U viral) = 1? 
P(both) = P(B n V) 
1 = 0.7 + 0.4 - P(BV) 
P(BV) = 0.1 

Finite Sample Spaces 

There are a finite # of outcomes S = {si, s n } 
Define pi = P(sj) as the probability function. 
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Pi > o,^Pi = i 



Classical, simple sample spaces - all outcomes have equal probabilities. 

= #(s) ; by counting methods. 
Multiplication rule: #(si) = m, #(s 2 ) = n, #(si x s 2 ) = mn 

Sampling without replacement: one at a time, order is important 

s\...s n outcomes 

k < n (k chosen from n) 

#(outcome vectors) = (ai, a 2 , dfc) = n(n — 1) x ... x (n — k + 1) = P^fc 

Example: order the numbers 1,2, and 3 in groups of 2. (1, 2) and (2, 1) are different. 

P 3 ,2 = 3 x 2 = 6 

P n ,n = n(n — 1) x ... x 1 = n! 



Example: Order 6 books on a shelf = 6! permutations. 

Sampling with replacement, k out of n 

number of possibilities = n x n x n... = n k 

Example: Birthday Problem- In a group of k people, 

what is the probability that 2 people will have the same birthday? 

Assume n = 365 and that birthdays are equally distributed throughout the year, no twins, etc. 

# of different combinations of birthdays= #(S = all possibilities) = 365* 

# where at least 2 are the same = #(5) — #(all are different) = 365 fe — P^^k 



(n-k)\ 



P(at least 2 have the same birthday) = 1 — 



365 fc 



Sampling without replacement, k at once 

Si...S n 

sample a subset of size k, bi...bk, if we aren't concerned with order. 



number of subsets = C n _k = 




each set can be ordered k! ways, so divide that out of P n .k 
C n .k - binomial coefficients 



Binomial Theorem: 




n 



■5 



There are (£) times that each term will show up in the expansion. 

Example: a - red balls, b - black balls. 

number of distinguishable ways to order in a row = 

a + b\ _ fa + b' 
a J V b 



Example: r\ + ... + = n: r; t = number of balls in each box; n, k given 
How many ways to split n objects into k sets? 
Visualize the balls in boxes, in a line - as shown: 



O 
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Fix the outer walls, rearrange the balls and the separators. 
If you fix the outer walls of the first and last boxes, 

you can rearrange the separators and the balls using the binomial theorem. 

There are n balls and k-1 separators (k boxes). 

Number of different ways to arrange the balls and separators = 



n + k-1 

n 



n + k — 1 
k-1 



Example: f(x\, X2, £fc), take n partial derivatives: 

Qnj 



d 2 xidx2d 5 xz...dxk 

k "boxes" ~» k "coordinates" 

n "balls" ~> n "partial derivatives" 

number of different partial derivatives = = ("fc^ 1 ) 

Example: In a deck of 52 cards, 5 cards are chosen. 

What is the probability that all 5 cards have different face values? 

total number of outcomes = ( 5 g 2 ) 

total number of face value combinations = (g 3 ) 

total number of suit possibilities, with replacement = 4 5 

( 13 )4 5 

P(all 5 different face values) = 5 b2 

\ 5 ) 

** End of Lecture 2. 



6 



